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but also the reasoning of probability-based inference. Repeated sam-
pling or repeated experimental randomization clearly produces variable
results. This variation is random in the technical sense, rather than
haphazard, because the design uses an explicit chance mechanism. So
an opinion poll's conclusion that 61% of all American adults want a
national health insurance system requires a margin of error that re-
flects the probable degree of random variation in similar sample surveys.
Similarly, the conclusion that a new medical treatment outperforms a
standard treatment can be sustained only if the margin of superiority
exceeds the probable random variation in similar experiments.

The random outcomes observed from data production are statistics
such as sample proportions and sample means. Sample statistics are
random variables (random phenomena having numerical values). The
regular long-term behavior of such statistics in repeated sampling or
repeated experimental randomization is described by a sampling dis-
tribution. It is usual to view sampling distributions as probability dis-
tributions of random variables. Random variables, their distributions,
and their moments make up another block of material in intermediate
probability.

Proportions involve the distribution of a count, which is binomial
under slightly idealized assumptions. Sample means have a normal dis-
tribution if the population distribution is normal. General rules for
manipulating means and variances of random variables apply to sam-
ple proportions and means. In particular, the standard deviations of
sample proportions and means both decrease at the rate l/\/n as the
sample size n increases, a fact that leads to an understanding of the
advantages of larger samples.

What happens as the number n of observations grows without bound?
The major limit theorems of probability address this question. The law
of large numbers says that sample proportions and means approach (in
various senses) the corresponding proportions and means in the under-
lying population. The central limit theorem says that both proportions
and means become approximately normally distributed as the sample
size grows.

Figure 8 illustrates the central limit theorem in graphical form. It
begins with the distribution of a single observation that is right skewed
and far from normal Distributions of this form are often used to de-
scribe the lifetime in service of parts that do not wear out. The mean of
this particular distribution is 1. The other curves in the figure show the
distribution of the mean 3c of samples of size 2 and of size 10 drawn
from the original distribution. The characteristic normal shape is al-
ready starting to emerge when only 10 observations are averaged. A
computer simulation could show the effect even more dramatically.